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Abstract. To study relationship between quantum finite automata and 
probabilistic finite automata, we introduce a notion of probabilistic re- 
versible automata (PRA, or doubly stochastic automata). We find that 
there is a strong relationship between different possible models of PRA 
and corresponding models of quantum finite automata. We also propose 
a classification of reversible finite 1-way automata. 



1 Introduction 

Here we introduce common notions used throughout the paper as well as sum- 
marize its contents. 

We analyze two models of probabilistic reversible automata in this paper, 
namely, 1-way PRA and 1.5-way PRA. 

In this section, we define notions applicable to both models in a quasi-formal 
way, including a general definition for probabilistic reversibility. These notions 
are defined formally in further sections. 

If not specified otherwise, we denote by S an input alphabet of an automaton. 

Every input word is enclosed into end-marker symbols # and $. Therefore 
we introduce a working alphabet as F ~ S U $}. 

By Q we normally understand the set of states of an automaton. 

By L we understand complement of a language L. 

Given an input word w, by |a;| we understand the number of symbols in lu and 
with [u>]i we denote i-th symbol of to, counting from the beginning (excluding 
end-markers) . 

Definition 1.1. A configuration of a finite automaton is c = {viqjVk), where 
the automaton is in a state qj £ Q, ViV^ £ ^U*$ is a finite word on the input 
tape and input tape head is above the first symbol of the word ■ 



Research partially supported by the Latvian Council of Science, grant No. 01.0354 
and grant for Ph.D. students; University of Latvia, K. Morbergs grant; European 
Commission, contract IST-1999-11234 

Research partially supported by the Latvian Council of Science, grant No. 01.0354 
and European Commission, contract IST-1999-11234 



By C we denote the set of all configurations of an automaton. This set is 
countably infinite. 

After its every step, a probabilistic automaton is in some probability distri- 
bution pqCq + piCi + . . . + p„c„, where po + Pi + • • • + = 1- Such probability 
distribution is called a superposition of configurations. Given an input word oj, 
the number of configurations in every accessible superposition does not exceed 
\Q\ in case of 1-way automata, and in case of 1.5-way automata. 

A linear closure of C forms a linear space, where every configuration can be 
viewed as a basis vector. This basis is called a canonical basis. Every probabilistic 
automaton defines a linear operator over this linear space. 

Let us consider A. Nayak's model of quantum automata with mixed states. 
(Evolution is characterized by a unitary matrix and subsequent measu remen ts 
are performed after each step, POVM measurements not being allowed, N 99|] .) 



If a result of every measurement is a single configuration, not a superposition, 
and measurements are performed after each step, we actually get a probabilistic 
automaton. However, the following property applies to such probabilistic au- 
tomata - their evolution matrices are doubly stochastic. This encourages us to 
give the following definition for probabilistic reversible automata: 

Definition 1.2. A probabilistic automaton is ca^terf reversible if its linear oper- 
ator can be described by a doubly stochastic matrix, using canonical basis. 

To make accessible configurations of type {qi^uj$), we assume that every word 
is written on a circular tape, and after the right end-marker $ the next symbol is 
the left end-marker Such precondition is the same as used for quantum finite 



automata. (See, for example, [ KW 97 |.) 

At least two definitions exist, how to interpret word acceptance, and hence, 
language recognition, for reversible automata. 

Definition 1.3. Classical acceptance. We say that an automaton accepts (re- 
jects ) a word classically, if its set of states consists of two disjoint subsets: ac- 
cepting states and rejecting states, and the following conditions hold: 

— the automaton accepts the word, if it is in accepting state after having read 
the last symbol of the word; 

— the automaton rejects the word, if it is in rejecting state after having read 
the last symbol of the word. 

We refer to the classical acceptance automata as C-automata further in the 
paper. 

Definition 1.4. "Decide and halt" acceptance. We say that an automaton ac- 
cepts (rejects) a word in a decide- and-halt manner, if its set of states consists 
of three disjoint subsets: accepting states, rejecting states and non-halting states, 
and the following conditions hold: 



— the computation is continued only if the automaton enters a non-halting 
state. 

— if the automaton enters an accepting state, the word is accepted; 



— if the automaton enters a rejecting state, the word is rejected. 

We refer to the decide-and-halt automata as DH-automata further in the paper. 

Having defined word acceptance, we define language recognition in an equiv- 
alent way as in |R 63 1. We consider only bounded error language recognition in 
this paper. 

By Px,A we denote the probability that a word x is accepted by an automaton 

A. 

Definition 1.5. We say that a language L is recognized with bounded error by 
an automaton A with interval (pi,P2) if Pi < P2 and pi — sup{Px^A \ x ^ L}, 
P2 = mi{Pj;^A \ X e L}. 

Definition 1.6. We say that a language is recognized with a probability p if the 
language is recognized with interval (1 —p,p). 

Definition 1.7. We say that a language is recognized with probability 1 — e, if 
for every e > there exists an automaton which recognizes the language with 
interval (ei, 1 — 62), where £1,62 £ £• 
s 

Definition 1.8. By q — > q' , S C S* , we denote that there is a positive prob- 
ability to get to a state q' by reading a single word ^ d S, starting in a state 

q- 

We refer to several existing models of quantum finite automata: 
1. Measure-once quantum finite automata | MC 97| ( QFA-MC); 



2. Measure-many quantum finite automata]] KW 97| (QFA-KW); 

3. Enhanced quantum finite automata |N 



Following the notions above, QFA-MC can be characterized as C-automata 
whereas QFA-KW and QFA-N as DH-automata. 

In Section ||, we discuss properties of PRA C-automata (PRA-C) . We prove 
that PRA-C recognize the class of languages 0^03 ... a* with probability 1 — e. 
This class can be recognized by QFA-KW, with worse acceptance probabilities, 
however |ABFK 99| . This also imphes that QFA-N recognize this class of lan- 
guages with probability 1 — e. 

Further, we show general class of regular languages, not recognizable by 
PRA-C. In particular, such languages as (a,b)*a and a(a,b)* are in this class. 
This class has strong s imilarities with the class of languages, not recognizable 
by QFA-KW [|AKV 00 1. 

We also show that the class of languages recognized by PRA-C is closed 
under boolean operations, inverse homomorphisms and word quotient, but is 
not closed under homomorphisms. 

In Section ^we prove, that PRA DH-automata do not recognize the language 
(a,b)*a. 

In Section ^ we discuss some properties of 1.5-way PRA. We also present 
an alternative notion of probabilistic reversibility, not connected with quantum 
automata. 

In Section || we propose a classification of reversible automata (deterministic, 
probabilistic and quantum). 



2 1-way Probabilistic Reversible C- Automata 

Definition 2.1. 1-way probabilistic reversible C-automaton (PRA-C) 

A — (Q, qo, Qf, 5) is specified by a finite set of states Q, a finite input alphabet 

S, an initial state qq G Q, a set of accepting states Qf Q, o,nd a transition 

function 

S : Q X r X Q — > IR[o,i], 

where F ^ S U {fj^, $} is the input tape alphabet of A and $ are end-markers 
not in S . Furthermore, transition function satisfies the following requirements: 

V(<Zi,(Ti) eQxr ^<5((7i,(Ti,<7) = 1 (1) 
V(gi,ai) eQxr ^,5(g,ai,gi) = l (2) 

For every input symbol a € F, the transition function may be determined 
by a \Q\ x \Q\ matrix ¥„, where = S{qj,a,qi). 

Lemma 2 .2. All matrices are doubly stochastic iff conditions ^ and of 
Definition 2A hold. 

Proof. Trivial. □ 



We define word acceptance as specified in Definition |1.3| . The set of rejecting 
states is Q \ Qf- We define language recognition as in Definition 1.5. 

A linear operator Ua corresponds to the automaton A. Formal definition of 
this operator follows: 

Definition 2.3. Given a configuration c = (viqjavk), 

Uac = ^ 5{qj,a, q){yiaqvk)- 

Given a superposition of configurations "0 = PcC, 



Using canonical basis, Ua is described by an infinite matrix Ma- 



To comply with Definition 1.2, we have to state the following: 



Lemma 2.4. Matrix Ma is doubly stochastic iff conditions and of Def- 
inition 2.1 hold. 

Proof. Condition takes place if and only if the sum of elements in every 
column in Ma equal to 1. Condition (||) takes place if and only if the sum of 
elements in every row in Ma equal to 1. □ 



This completes our formal definition of PRA-C. 

Use of end-markers does not affect computational power of PRA-C. For ev- 
ery PRA-C with end-markers which recognizes some language it is possible to 
construct a PRA-C without end-markers which recognizes the same language. 
(Number of states needed may increase, however.) See Appendix for further 
details. 

Lemma 2.5. If a language is recognized by a PRA-C A with interval {pi,p2), 
exists a PRA-C which recognizes the language with probability p, where 



P2 



_ J P1+P2 ' 



if Pi +P2 > 1 



Proof. Let us assume, that the automaton A has n — 1 states. We consider the 
case pi +P2 > 1- 

Informally, having read end-marker symbol we simulate the automaton A 
with probability ^^^^^ and reject input with probability ^p^^^""'" ■ 

Formally, to recognize the language with probability ^^^^^ , we modify the 
automaton A. We add a new state qr ^ Qf, and change the transition function 
in the following way: 



- Vcr, (T / #, S{qr,cr,qr) = 1; 

- Vg, 9 7^ qr, S{qQ, #, q) = ^^Soid{qo, #, q)- 

Now the automaton has n states. Since end-marker symbol # is read only once at 
the beginning of an input word, we can disregard the rest of transition function 
values, associated with #: Vqi, qj, where qi ^ go, S{qi, #, qj) = ^"'^I'fl'f ' — 



The transition function satisfies the requirements of Definition 2.1 and the 
constructed automaton recognizes the language with probability ^^^^^ . 

The case pi -\- P2 < 1 is very similar. Informally, having read end-marker 
symbol we simulate the automaton A with probability 2-pl-p2 ^^^^ accept 
input with probability 2~pl~pl • '-' 

Theorem 2.6. // a language is recognized by a PRA-C, it is recognized by 
PRA-C with probability 1 — e. 

Proof. We assume that a language L is recognized by a PRA-C automaton 
A = {Q, E, qo,QF, S) with interval (pi,p2)- Let 6 = -\-p2)- 

Let us consider a system of m copies of the automaton A, denoted as Am- 
We say that our system has accepted (rejected) a word if more (less or equal) 
than mS automata in the system have accepted (rejected) the word. We define 



language recognition as in Definition 1.5 



Let us consider a word uj E L. The automaton A accepts to with probability 
Pui > P2- As a result of reading w, fi':^ automata of the system accept the word, 
and the rest reject it. The system has accepted the word, if ^ > i5. Let us take 



7^0, such that < rjo < p2 ^ S < Pw — 5. Estimating the probabiUty that ^ > (5, 
we have 
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TO 
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(3) 



In case of to Bernoulh trials, Chebyshev's inequahty may be used to prove the 
following ( |GS 97| , p. 312): 
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The last inequality induces that 
P 
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Finally, putting (||) and (||) together 

M 



m 



> 1 - 



1 



(4) 



(5) 



(6) 



Inequality is true for every to £ L. 

On the other hand, let us consider a word ^ L. The automaton A accepts 
^ with probability < pi- If we take the same 770 j < 770 < 5 —pi < (5 — and 
for every ^ we have 



P 



^ > 6 



< P 



M^ 
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Due to (H) and (0), for every e > 0, if we take 



Vo 



n > 



< 



1 



4TOr/Q 



(7) 



, we get a system An 



which recognizes the language L with interval (ei, 1 — £2), where ei,e2 < 

Let us show that A„ can be simulated by a PRA-C. The automaton A' = 
{Q' , S, Qq, Q'p, 6') is constructed as follows: 

Q' = {{<lsiqs2 ■ --QsJ \ < s^ < \Q\ ~ 1}; Qq = (gogo • • - go)- 
A sequence {qsiqs2 ■ ■ ■ ^s^} is an accepting state of A' if more than nS elements 
in the sequence are accepting states of A. We have defined the set Q'p. 

n 

Given cr S T, S'{{qa^qa2 ■■■qaj,cr, {qb^qi,^ . ..?(,„)) = Jl ^{qai, cr, qb,). 

1=1 

In essence, Q' is n-th Cartesian power of Q and the linear space formed by 
A' is n-th tensor power of the linear space formed by A. If we take a symbol 
cr G -T, transition is determined by \Q\" x \Q\" matrix Vj!, which is n-th matrix 

n 

direct power of i.e, — ® 

1=1 

A' simulates the system A„. Since matrix direct product of two doubly 
stochastic matrices is a doubly stochastic matrix, Vcr are doubly stochas- 
tic matrices. Therefore our automaton A' is a PRA-C. 

We have proved that Ve > the language L is recognized by some PRA-C 
with interval (ei, 1 —£2), where ei, £2 < £• Therefore the language L is recognized 
with probability 1 — e. □ 



Lemma 2.7. // a language Li is recognizable with probability greater than | 
and a language L2 is recognizable with probability greater than | then languages 
Li n L2 and Li U L2 are recognizable with probability greater than i. 

Proof. Let us consider automata A = (Qa, 9o,a, Qf,a, Sa) and 
B = {Qb, S,qo,B,QF,B,SB) which recognize the languages Li, L2 with proba- 
bihties pi,P2 > §, respectively. Let us assume that A,B have m and n states, 
respectively. Without loss of generality we can assume that pi < P2- 

Informally, having read end- marker symbol with probability ^ we simulate 
the automaton Ai and with the same probability we simulate the automaton A2. 

Formally, we construct an automaton C = {Q, S , q^, Qp, S) with the following 
properties. 

Q = U Qb; qa = go, a; Qf = Qf,a U Qf,b; (5 = (5a U Sb, with an exception 
that: 

- S{qQ,#,qi,A) = ^'5a((7o,#, 

- Siqo,#,qi.B) 2 '^s (go, #,9^,5); 

- Vg., q, ^ qo, 6{q,,if,q) = '-^^0^- 



P1+P2 ' 



Since d satisfies Definition 2.1, our construction of PRA-C is complete. 

The automaton C recognizes the language Li n L2 with interval (p, 
where p<l - \pi. (Since pi,P2 > \, I - \pi < Hi±£2.) 

The automaton C recognizes the language Li UL2 with interval (^— ^^5— 
where p > \pi. (Again, ' ^~pi ~P'^ < ip^) 

Therefore by Lemma the languages Li nL2 and Li UL2 are recognizable 
with probabilities greater than i. □ 

Theorem 2.8. The class of languages recognized by PRA-C is closed under 
intersection, union and complement. 

Proof. Let us consider languages Li,L2 recognized by some PRA-C automata. 
By Theorem 2.6, the se l ang uage s is recognizable with probability 1 — e, and 
therefore by Lemmas 2.5 and 2.7, union and intersection of these languages are 
also recognizable. If a language L is recognizable by a PRA-C A, we can construct 
an automaton which recognizes a language L just by making accepting states of 
A to be rejecting, and vice versa. □ 

It is natural to ask what are the languages recognized by PRA-C with prob- 
ability exactly 1. 

Theorem 2.9. // a language is recognized by a PRA-C with probability 1, the 
language is recognized by a permutation automaton. 

Proof. Let us consider a language L and a PRA-C A, which recognizes L with 
probability 1. 

If a word is in L, the automaton A has to accept the word with probability 
1. Conversely, if a word is not in L, the word must be accepted with probability 
0. Therefore, 

^q ^ Q Vw e S* either quj Q Qf, or qui C Qp. (8) 



Consider a relation between the states of A defined as 

R = {(qi,qj) I Vcj QiLU C Qp <^ qjuj C Qp}. R is symmetric, reflexive 
and transitive, therefore Q can be partitioned into equivalence classes Q/R = 
{[qo], [qii], • ■ • , [lik]}- Suppose A is in a state q. Due to (||), Vw 3n quj C [qi,J. In 
fact, having read a symbol in the alphabet, A goes from one equivalence class 
to another with probability 1. 

Hence it is possible to construct the following deterministic automaton D, 
which simulates A. The states are sq, . . . , Sfc and s„cr = s„i iff [g^jjcr C [(7i,,J and 
Sn is an accepting state iff [g^^J C Qp. Since all transition matrices of A are 
doubly stochastic, all transition matrices of D are permutation matrices. □ 

Theorem 2.10. The class of languages recognized by PRA-C is closed under 
inverse homomorphisms. 

Proof. Let us consider finite alphabets S,T, a homomorphism h : S — > T*, a 
language L C T* and a PRA-C A = {Q,T,qo,Qp,S), which recognizes L with 
interval (pi,p2). We prove that exists an automaton B = (Q, S, go, Qf, S') which 
recognizes the language h~^{L). 

Transition function 5 of A sets transition matrices Vr, where r e T. To 
determine S', we define transition matrices Va, <y £ S. Let us define a transition 
matrix Va-^. : 

where m = \h{ak)\. Multiplication of two doubly stochastic matrices is a doubly 
stochastic matrix, therefore _B is a PRA-C. Automaton B recognizes h^^{L) 
with the same interval {pi,p2). □ 

Corollary 2.11. The class of languages recognized by PRA-C is closed under 
word quotient. 

Proof. This follows from closure under inverse homomorphisms and presence of 
end-markers #, $. □ 

Even if PRA-C without end-markers are considered, closure under word quo- 
tient remains true. See Appendix for details. 



Lemma 2.12. If A is a doubly stochastic matrix and X - a vector, then 
max(X) > max{AX) and mm{X) < mm{AX). 
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doubly stochastic. Let us suppose that Xj — max(X). For any i, 1 < i < n, 



X, = OixXj -I- ai2X. + . . . + ainXj > anXi + 012X2 + . . . + OinX. 



Therefore Xj is greater or equal than any component of AX . The second inequal- 
ity is proved in the same way. □ 



Theorem 2.13. For every natural positive n, a language Ln = alai, ... a* is 
recognizable by some PRA-C with alphabet {ai, 02, . . . , a„}. 



Proof. We construct a PRA-C with n + 1 states, go being the initial state, cor- 
responding to probabiUty distribution vector 



determined by (n -I- 1) x (n -I- 1) matrices 

/i i 

/I ... 0\ / ^ ^ u 





V / 



The transition function is 
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The accepting states are go . . -qn-i, the only rejecting state is We prove, 
that the automaton recognizes the language L„. 

Case u! S L„. Having read cu a* . . . d^-i'^k ■• automaton is in probability 



distribution 



Therefore all to £ Ln are accepted with probability 1. 



V / 



Case uj ^ Ln- Consider k such that lo — L0iaL02, |wi| = fc, wi £ and 
wiiT ^ i„. Since all one-letter words are in L„, fc > 0. Let at = [uj\k and Og — <t. 



So we have s < t, l<s<n— l,2<t<n. Having read £ a| 



the 



automaton is in distribution 



After that, having read a^, the automaton is 



in distribution 







n — s+1 







\ 



n— s+1 



71 — S + l 

So the word cjia^ is accepted with probabihty 1 



Vo; 



t{n-s+l) 
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> ri-s+1 



V t(n 



-TT-^—^TiT. By Lemma p.l2|, since 
t{n~s+i) ^ 7' reading the symbols succeeding wittg does not increase accepting 
probability. Therefore, to find maximum accepting probability for words not in 



Ln, we have to maximize 1 



t-s 



where s < t, l<s<n — l,2<t<n. 



t(n-s+l) ' 

Solving this problem, we get t = k + l,s = k for n = 2k, and we get t = 
k + 1, s = k or t = k + 2, s = k + l for n = 2k + 1. So the maximum accepting 



probability is 1 



if n = 2k, and it is 1 



(fc+iKfc+2) ' 



2k + I. All in 



(fc+i)^ ' 

all, the automaton recognizes the lanffuage with interval I 1 — i , „ i 

(Actually, by Theorem ^.6| , Ln can be recognized with probability 1 — e). □ 

Corollary 2.14. Quantum finite automata with mixed states (model of Nayak, 
I N 9!^ ) recognize L„ — 0^03 ■ • ■ with probability 1 — e. 



Proof. This come s from the fact, that matrices Va^ , K2 j ■ ■ • i K„ from the proof 
of Theorem 2.13 (as well as tensor powers of those matrices) all have unitary 
prototypes (see Definition 5.1). □ 



Definition 2.15. We say that a regular language is of type (*) if the following 

is true for the minimal deterministic automaton recognizing this language: Exist 
three states q, qi, q2, exist words x, y such that 

1- qi # 92; 

2. qx = qi, qy ^ 92/ 

3. qix = qi, q2y = 92/ 

4- yt e (x, y)* 3ti e {x, y)* qitti = qi; 
5. yt e {x,y)* 3t2 e {x,y)* q2tt2 = (72. 

Definition 2.16. We say that a regular language is of type (*') if the following 
is true for the minimal deterministic automaton recognizing this language: Exist 
three states q, qi, q2, exist words x, y such that 

1- qi 7^ q2; 

2. qx = qi, qy ^ q2; 

3. qix = qi, qiy = qi; 

4. q2X = q2, q2y = q2- 




Fig. 1. Type (*) construction 




Fig. 2. Type (*') construction 



Definition 2.17. We say that a regular language is of type {*") if the following 
is true for the minimal deterministic automaton recognizing this language: Exist 
two states qi, q2, exist words x, y such that 

1- qi 7^ 92,- 

2. qix = q2, q2X = 92/ 

3- q2y = qi- 




Fig. 3. Type (*") construction 



Type (*") languages are exactly those languages that violate the partial order 



condition of [BP 99| 



Lemma 2.18. If A is a deterministic finite automaton with a set of states Q 
and alphabet E, then \/q G Q G E* 3k > qx^ = qx'^^ . 

Proof. We paraphrase a result from the theory of finite semigroups. Consider 
a state q and a word x. Since number of states is finite, 3m > 3s > 1 
Vn gx™ = gx^x'". Take no, such that stiq > to. Note that Vt > gx"'+* = 
gx"+*x''"o. We take t = sn^ - to, so gx"*"" = qx'*"ox'*"o. Take k ^ suq. □ 

Lemma 2.19. A regular language is of type (*) iff it is of type (*') or type {*")■ 

Proof. 1) If a language is of type (*'), it is of type (*). Obvious. 

2) If a language is of type (*"), it is of type (*). Consider a language of type 
(*") with states g",g2 words x",y". To build construction of type (*), we 
take q = qi = q'l, (72 = <Z2i ^ — x"y" ^ y = x" . That forms transitions qx — qi, 
qy — q2, qix = qi, qiy = q2, q2X — gi, q2y = q2- We have satisfied all the rules 
of (*). 

3) If a language is of type (*), it is of type (*') or (*"). Consider a language 



whose minimal deterministic automaton has construction (*). By Lemma 2.18 



3t3b qiy^ = qt and qty^ = qt\ 
3u3c q2x'' = qu and qux" = qu. 

If qi ^ qt, by the 4th rule of (*), 3z qtz = qi. Therefore the language is of type 
(*"). If q2 ^ qu, by the 5th rule of (*), 3z quZ ~ q2, and the language is of type 
(*")• 

If qi = qt and (?2 = <?«, we have qx'' = qi, qy'' = q2, qix" = qiy^ = qi, q2x'' = 
Q2y^ — 52 • We get the construction (*') if we take x' = x^, y' = y'^. □ 

We are going to prove that every language of type (*) is not recognizable by 
any PRA-C. For this purpose, we recall several definitions from the theory of 



finite Markov chains (|KS 76 1, etc.) 



A Markov chain with n states can be determined by an n x n stochastic 
matrix A, i.e., matrix, where the sum of elements of every column in the matrix 

is 1. If Ai,j = p > 0, it means that a state qi is accessible from a state qj with 
a positive probability p in one step. Generally speaking, the matrix depends on 
the numbering of the states; if the states arc renumbered, the matrix changes, 
as its rows and columns also need to be renumbered. 

Definition 2.20. A state qj is accessible from qi (denoted qi —>■ qj) if there is 
a positive probability to get from qi to qj (possibly in several steps). 

Definition 2.21. States Qi and qj communicate (denoted q^ <-> qj) if q^ — > qj 
and qj qi . 

Definition 2.22. A state q is called ergodic ifMiq^qi^qi^ q. Otherwise 

the state is called transient. 

Definition 2.23. A Markov chain without transient states is called irreducible 
if for all qi,qj qi ^ qj. Otherwise the chain without transient states is called 
reducible. 

Definition 2.24. The period of a,n ergodic state qi <E Q of a Markov chain with 

a matrix A is defined as d{qi) = gcd{n > | > 0}. 

Definition 2.25. An ergodic state q^ is called aperiodic if d{qi) = 1. Otherwise 
the ergodic state is called periodic. 

Definition 2.26. A Markov chain without transient states is called aperiodic if 
all its states are aperiodic. Otherwise the chain without transient states is called 

periodic. 

Definition 2.27. A probability distribution X of a Markov chain with a matrix 
A is called stationary, if AX = X. 

Definition 2.28. A Markov chain is called doubly stochastic, if its transition 
matrix is a doubly stochastic matrix. 

We recall the following theorem from the theory of finite Markov chains: 

Theorem 2.29. // a Markov chain with a matrix A is irreducible and aperiodic, 



Corollary 2.30. // a doubly stochastic Markov chain with anmxm matrix A 
is irreducible and aperiodic. 



then 



a) it has a unique stationary distribution Z; 

b) lim A" = (Z, . . . , Z); 



c) yX lim = Z. 




Proof. By Theorem 2.29 



□ 



Lemma 2.31. If M is a doubly stochastic Markov chain with a matrix A, then 
Wq q. 

Proof. Assume existence of qo such that qo is not accessible from itself. Let 
Qqo — {li I 1o ~^ Qi} — {917 • ■ • J Qk}- Qqa is not empty set. Consider those rows 
and columns of A, which are indexed by states in Qq^ . These rows and columns 
form a submatrix A' . Each column j of A' must include all non-zero elements 
of the corresponding column of A as those states are accessible from the state 

k 

qj, hence also from qo and are in Q^^. Therefore Vj, 1 < j < k, J2 ^'i j — ^ 

i=l 

J2 ^ij — k. On the other hand, since qo ^ Qqg, a row of A' indexed by a 

l<i,j<k 

state accessible in one step from qo does not include all nonzero elements. Since 

k 

A is doubly stochastic, 3i, 1 < i < fc, ^ A'^ ^ < 1 and ^ ^'i j ^- "^^^^^ ^ 

j = l ' l<i,j<k 

contradiction. □ 

Corollary 2.32. Suppose A is a doubly stochastic matrix. Then exists k > 0, 
such that yi {A'^)iA > 0. 



Proof. Consider an m x to doubly stochastic matrix A. By Lemma 2.31, Vi 

rn 

3n,; > > 0. Take n = JJ Us. For every i, (A")^,^ > 0. □ 

s=l 

Lemma 2.33. If M is a doubly stochastic Markov chain with a matrix A, then 
Wqa, qb Ab^a > ^ qb ^ qa- 

Proof. Ab,a > means that qb is accessible from qa in one step. We have to 
prove, that qb —> qa- Assume from the contrary, that qa is not a ccessible from 
qb. Let Qq^ = {qi \ qb - > = {(71,92, ■ ■ • By Lemma ^.Slj qb G Qq^. As 

in proof of Lemma 2.31, consider a matrix A', which is a submatrix of A and 
whose rows and columns are indexed by states in Qq^. Each column j has to 
include all nonzero elements of the corresponding column of A. Therefore Vj, 

k 

1 < J < fc, I] ^i.j = 1 and J2 = ^- On the other hand, Ai,^a > 

i—l l<i,j<k 

and qa ^ Qg^, therefore a row of A' indexed by qb does not include all nonzero 

k 

elements. Since A is doubly stochastic, ^ A'j, j < 1 and ^ A'^ j < k. This is 

j—l l<~ij<k 

a contradiction. □ 

Corollary 2.34. If M is a doubly stochastic Markov chain and qa —>■ qb, then 
qa ^ qb- 

Proof. If qa qb then exists a sequence , , . . . , qj^, , s uch that Ai-^^a > 
0, Ai^^i^ > 0, . . . > 0, Ab^i^ > 0. By Lemma pT33| , we get qb g^^, 

lik • ■ ■> *2 fti) Qii Qa- Therefore qb qa- □ 



By Corollary 2.34, every doubly stochastic Markov chain does not have tran- 
sient states, so it is either periodic or aperiodic, either reducible or irreducible. 

Lemma 2.35. // a regular language is of type (*'), it is not recognizable by any 
PRA-C. 

Proof. Assume from the contrary, that A is a PRA-C automaton which recog- 
nizes a language L C Z"* of type (*'). 

Since L is of type (*'), it is recognized by a deterministic automaton D which 
has three states q, qi, q2 such that qi ^ q2, qx — qi, qy = q2, qix = (71, qiy = qi, 
q2X = q2, q2y — 92, where x,y G U*. Furthermore, exists uj e S* such that 
qouj ~ q, where qo is an initial state of D, and exists a word z £ S*, such that 
Qiz — qacc if and only li q2Z = qrej, where qacc is an accepting state and qrej is 
a rejecting state of D. Without loss of generality we assume that qiz — qacc and 

q2Z = qrej- 

The transition function of the automaton A is determined by doubly stochas- 
tic matrices Va-^ , ■ • • , Va-„ ■ The words from the construction (*') are x = ai-^ . . . Ui^. 
and y = Uj-^ . . . <jj^ . The transitions induced by words x and y are determined 
by doubly stochastic matrices X = Va^^- ■ ■ Vc-^ and Y = Va^^- ■ ■ V^j^ ■ Similarly, 
the transitions induced by words uj and z are determined by doubly stochastic 
matrices W and Z. By Corollary ^.32 , exists K > 0, such that 

(X^),,, > and (r^),M > 0. (9) 
Consider a relation between the states of the automaton defined as i? = 
{{qi,qj) I qi — — > qj}. By (y), this relation is reflexive. 

Suppose exists a word ^ = ^1^2 ■ ■ • Cfci £ {x^ , U^}, such that q q' . This 
means that q g^^, qi^ qi^,. . ., q' ■ By Corollary 2.34, since both 

and are doubly stochastic, 3^^...^^, e {(a;^)*, (y^^)*}, such that 

1' ^ Qtk-i^- ■ •> ^2 ^ Qti, *i ^ <?: therefore q' ^ q, where ^ e (a^^,?/^)*- 
So the relation R is symmetric. 

Surely R is transitive. Therefore all states of A may be partitioned into 
equivalence classes [qo], [gij, . . . , [qi„]- Let us renumber the states of A in such 
a way, that states from one equivalence class have consecutive numbers. First 
come the states in [qo], then in [qi-^], etc. 

Consider the word x^y^ . The transition induced by this word is determined 
by a doubly stochastic matrix C = X^ . We prove the following proposition. 
States qa and qf, are in one equivalence class if and only if qa qb with matrix 
C. Suppose qa — > qb- Then {qa,qb) G R, and qa,<lb are in one equivalence class. 
Suppose qa, qb are in one equivalence class. Then 

qa ^ qn,<ln qt2,-- ■,qtk-i ^ qb, where e {a;^,y^}. (10) 

By (H), qi > qi and qj > qj. Therefore, if qi — > qj, then qi — > qj, and 

again, if qi — > qj, then qi — > qj. That transforms ( |10| ) to 

ga — >■ (Zb, where t > 0. (11) 



We have proved the proposition. 

By the proved proposition, due to the renumbering of states, matrix C 
is a block diagonal matrix, where each block corresponds to an equivalence 
class of the relation R. Let us identify these blocks as Cq, Ci, . . . , C„. By (^), 
a Markov chain with matrix C is aperiodic. Therefore each block Cr corre- 
sponds to an aperiodic irreducible doubly stochastic Markov chain with states 
[qi^]. By Corollary 2.30, lim C™ = J, J is a block diagonal matrix, where 

for each [p x p) block Cr {Cr)i,j = ^- Relation qi — > qj is a subrclation 
of R, therefore is a block diagonal matrix with the same block ordering 
and sizes as C and J. (This does not eliminate possibility that some block 
of Y^ is constituted of smaller blocks, however.) Therefore JY'^ = J, and 
lim Z(r^X^)"W lim ZiY'^ X'^)"'Y^W = ZJW. So 



Ve > Bm 



fz(y^x^)"W - Z{Y'^X'^)"'Y^w)Qo 



< e. 



(12) 



However, by construction (*'), Vfc Vm u){x^y^)"'' z G L and ujy^ {x^ y^Y"" z ^ L. 
This requires existence of e > 0, such that 



Vm ( z(r^x^) 



Y^W]Q. 



> e. 



(13) 



This is a contradiction. 



□ 



Lemma 2.36. // a regular language is of type {*"), it is not recognizable by any 
PRA-C. 



Proof. Proof is nearly identical to that of Lemma 2.35| . Consider a PRA-C 
which recognizes the language L of type (*")• We prove that for words x, y 
exists constant K, such that for every e exists m, such that for two words 
^1 = u{x^ {xy)^Y^z and ^2 = uj{x^ {xy)^)"^x^ z, \p^^ — ^^2! < We can 
choose z, such that ^1 G L iff ^2 ^ i- □ 



Theorem 2.37. If a regular language is of type (*), it is not recognizable by any 
PRA-C. 



Proof. By Lemmas 2.19, 2.35, 2.36 



□ 



We proved (Lemma f2.19 ) that the construction of type (*) is a generalization 
the construction proposed by |BP 99 1. Also it can be easily noticed, that the 
type (*) construction is a generalization of construction proposed by |AKV 0C|. 
(Constructions of [BP 99 1 and |AKV 0C| chara cterize l anguages, not recognized 
by measure-many quantum finite automata of | KW 97 ].) 



Corollary 2.38. Languages (a,b)*a and a(a,b)* are not recognized by PRA-C. 



Proof. Both languages are of type (*). 



□ 



Corollary 2.39. Class of languages recognizable by PRA-C is not closed under 
homomorphisms. 



Proof. Consider a homomorphism a ^ a, b ^ b, c a. Similarly as in Theorem 
^.13 , the language (a,b)*cc* is rec ogniz able by a PRA-C. (Take n = 2, 14 = 14^, 
Vb = Ki, Vc = Va^ from Theorem ^.13 , Qf = {qi}) However, by Corollary 2.38 



the language (a,b)*aa*=(a,b)*a is not recognizable. □ 



3 1-way Probabilistic Reversible DH- Automata 



Definition 3.1. The definition differs from one for PRA-C (Definition 2.1) by 



the following: languages are recognized according to Definition I.4 



It is easy to see that the class of languages recognized by PRA-C is a proper 
subclass of languages recognized by PRA-DH. For example, the language a(a,b)* 
is recognizable by PRA-DH. However, the following theorem holds: 

Theorem 3.2. Language (a,b)*a is not recognized by PRA-DH. 

Proof. Assume from the contrary that such automaton exists. While reading 
any sequence of a and b, this automaton can halt only with some probability p 
strictly less then 1, so accepting and rejecting probabilities may differ only by 
1-p, because any word belonging to the language is not dependent on any prefix. 
Therefore for each e > we can find that after reading of a prefix of certain 
length, the total probability to halt while continue reading the word is less then e. 



In this case we can apply similar techniques as in the proof of Lemma 2.35 , such 
that for words x, y exists constant K, such that for every e exists s, such that for 
two words 5i = u{x^ {xy)^Y z and ^2 = uj{x^ {xy)^yx^ z, \p^.^ — p^jl < e. □ 



4 Alternative Approach to Finite Reversible Automata 
and 1.5- way Probabilistic Reversible Automata 

Let us consider automaton A' = {Q, S, go, Qf, S') that can be obtained from a 
probabilistic automaton A = (Q, S, qo, Qp, 6) by specifying 
d'{q, a, q') — S{q', a, q) for all q' , a and q. 

If A' is a valid probabilistic automaton then we can call A and A' probabilistic 
reversible automata. 

Definition 4.1. An automaton of some type is called weakly reversible if the 

reverse of its transition function corresponds to the transition function of a valid 
automaton of the same type. 

Note: in case of deterministic automaton where 5 : Q x F x Q — > {0, 1} this 
property means that A' is still deterministic automaton, not nondcterministic. 

In case of one-way automata it is easy to check that this definition is equiv- 
alent to the one in Section ||. 

We give an example that illustrates that in case of 1.5- way automata these 
definitions are different. 



Definition 4.2. 1.5-way probabilistic weakly reversible C-automaton 

A — {Q, I],qo,QF^S) is specified by Q, S, qq, Qp defined as in 1-way PRA-C 

Definition 2.1, and a transition function 



S-.QxTxQxD — > ]R[o,i], 

where F defined as in 1-way PRA-C definition and D — {0, 1} denotes whether 
automaton stays on the same position or moves one letter ahead on the input 
tape. Furthermore, transition function satisfies the following requirements: 



y{quai)eQxF S{qi,c7,,q,d)^l (14) 

qeQ,deD 

V(qi,fTi) eQxr J2 S{q,ai,qi,d) = l (15) 

qeQ,deD 

Definition 4.3. 1.5-way probabilistic reversible C-automaton 

A — [Q, I],qQ,Qp,S) is specified by Q, S, qo, Qp defined as in 1-way PRA-C 



Definition 2.1, and a transition function 

S:QxFxQxD — > M[o,i], 

where F defined as in 1-way PRA-C definition and D — {0, 1} denotes whether 
automaton stays on the same position or moves one letter ahead on the input 
tape. Furthermore, transition function satisfies the following requirements: 

V{quai)eQxF S{qi,ai,q,d)^l (16) 

qeQ,deD 

W{qi,ai,a2)eQxF^ Y^('i^'^^^1^^^)+ J2 -5(9, ^2, gi, 1) - 1 (17) 

qeQ qeQ,<jer 

Theorem 4.4. Language (a,b)*a is recognizable by 1.5-way weakly reversible 
PRA-C. 

Proof. The Q ~ {go, Qf ~ ^ is defined as follows 

(5(go,a, go,0) = ^ (5(go, a, gi, 1) = ^ (5(gi, a, go, 0) = ^ i5(gi, a, gi, 1) = ^ 
(S(go,6,go, 1) = | (5(go, 6, gi, 0) ^ 5{qi,b,qo, 1) = 2 S{qi,b,qi,0) = ^ 
S{qo, $, go, 1) = 1 (5(gi, $, gi, 1) = 1 

It is easy to check that such automaton moves ahead according to the tran- 
sition of the following deterministic automaton 
(5(go,a,gi, 1) = 1 (5(gi, a, gi, 1) = 1 
(5(go,6,go, 1) = 1 6{qi,b,qo, 1) = 1 

(5(go, $, go, 1) = 1 ^(gi, $, gi, 1) = 1 

So the probability of wrong answer is 0. The probability to be at the m-th 
position of the input tape after n steps of calculation for m < n is C™ . Therefore 
it is necessary no more than 0{n * log(p)) steps to reach the end of the word of 
length n (and so obtain correct answer) with probability 1 ^ ^- n 



5 A Classification of Reversible Automata 

We propose the following classification for finite 1-way reversible automata: 





C-automata 


DH-automata 


Deterministic 
Automata 


Permutation Automata 


Reversible Finite Automata 


[HS 66, T 68| (DRA-C) 


|AF 98| (DRA-DH) 


Quantum 
Automata with 
Pure States 


Measure-Once Quantum 


Measure-Many Quantum 


Finite Automata |MC 97| 


Finite Automata |KW 97 1 


(QRA-P-C) 


(QRA-P-DH) 


Probabilistic 
Automata 


Probabilistic Reversible 
C-automata (PRA-C) 


Probabilistic Reversible 
DH-automata (PRA-DH) 


Quantum Finite 
Automata with 
Mixed States 


not considered yet 
(QRA-M-C) 


Enhanced Quantum 
Finite Automata |N 99(1 
(QRA-M-DH) 



Language class problems are solved for DRA-C, DRA-DH, QRA-P-C, for 
the rest types they are still open. Every type of DH-automata may simulate the 
corresponding type of C-automata. 

Generally, language classes recognized by C-automata are closed under 
boolean operations (though this is open for QRA-M-C), while DH-automata are 
not (though this is open for QRA-M-DH and possibly for PRA-DH). 

Definition 5.1. We say that a unitary matrix U is a prototype for a doubly 
stochastic matrix S, if\/i,j \Ui,j\'^ — 5; 



for example. 



Not every doubly stochastic matrix has a unitary prototype. Such matrix is, 

22" 
i i 

2^2 

i i 

,22, 

In Introduction, we demonstrated some relation between PRA-C and QRA- 
M-DH (and hence, QRA-M-C). However, due to the example above, we do not 
know exactly, whether every PRA-C can be simulated by QRA-M-C, or whether 
every PRA-DH can be simulated by QRA-M-DH. 

Theorem 5.2. // all matrices of a PRA-C have unitary prototypes, then the 
PRA-C may be simulated by a QRA-M-C and by a QRA-M-DH. 



Proof. Trivial. 



□ 



Theorem 5.3. // all matrices of a PRA-DH have unitary prototypes, then the 
PRA-DH may be simulated by a QRA-M-DH. 



Proof. Trivial. 



□ 
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A End-Marker Theorems for PRA-C Automata 

We denote a PRA-C with both end-markers as #,$-PRA-C. We denote a PRA-C 
with left end-marker only as #-PRA-C. 

Theorem A.l. Let A be a #,$-PRA-C, which recognizes a language L. There 
exists a #- PRA-C which recognizes the same language. 

Proof. Suppose A ~ [Q, S, go, Qp, S), where \Q\ — n. A recognizes L with inter- 
val (pi,_P2)- We construct the following automaton A' = [Q' , S, 50,01 Q'fi with 
mn states. Informally, A' equiprobably simulates m copies of the automaton A. 

Q' = {90,0, ■ • ■ , 90.m-l, qifl, ■ ■ ■ 1 <?l,m-l, • ■ ■ , 9n-l,0, • ■ ■ j 9n-l,m-l}- 

if.^#,5'(,.,„a,,,,) = {^J';-,7;;^^' = ' 

Otherwise, (5'(go,o, #, gj,;) = ;^^(go, #, and if gj,fc ^ qo.o, 5'(<7j,fc, #, g) = 
i-'^'(';o.o.#:'?) 



Function d' satisfies the requirements (fih and (H) of Definition 2.1 



We define Q'p as follows. A state qi^k G Q'p if and only if < fc < ■mp{qi), 
where = ^l'?*. 

qeQp 

Suppose 4I^LJ% is an input word. Having read A is in superposition 

n — 1 n — 1 

^ a"gi. After A has read $, #w$ is accepted with probabihty — ^ afp{qi). 

i=0 i=0 

m — 1 n — 1 

On the other hand, having read #a;, A' is in superposition — S ^flij- 

n-1 

So the input word is accepted with probability p'^ = — J2 \''^P{Q^)^ ■ 

™ 1=0 

n — 1 n — 1 

Consider uj G L. Then = ;^ L r™p(9i)l > I] = Pc^ > P2- 

1=0 1=0 
n — 1 n — 1 n— 1 

Consider C ^ Then p'^ ^ ^ E 4\^v{q^)^ < E 4piQ^) + ^E4 = 

i=0 i=0 i=0 

Therefore A' recognizes L with bounded error, provided m > — - — . □ 

Now we are going to prove that PRA-C without end-markers recognize the 
same languages as #-PRA-C automata. 

If A is a #-PRA-C, then, having read the left end-marker #, the automa- 
ton simulates some other automata Aq, Ai, . . . , A^^-i with positive probabilities 
Po, ■ ■ • ,Pm-i: respectively. Aq, Ai, . . . , A„^^i are automata without end-markers. 
By Pi,uj, < i < TO, we denote the probability that the automaton Ai accepts 
the word to. 

We prove the following lemma first. 

Lemma A. 2. Suppose A' is a #-PRA-C which recognizes a language L with 
interval (01,02). Then for every < e < 1, exists a #-PRA-C A which 
recognizes L with interval (01,02), such that 

a) ifujE L, pa,u+Pi,u + • • ■ +Pn-i,c^ > 

b) ifuj(f. L, po,t^ +Pl,u + • • • +Pn-l,^ < f^. 

Here n is the number of automata without end-markers, being simulated by A, 
and Pi^uj is the probability that i-th simulated automaton Ai accepts oj. 

Proof. Suppose a #-PRA-C A' recognizes a language L with interval (01,02). 
Having read the symbol #, A' simulates automata A'^, . . . , A'.^_i with probabil- 
ities Pq, . . . ,Pm-i: respectively. We choose e, < e < 1. 

By Dirichlet's principle ( |HW 79[ , p. 170), V^? > exists n G IN+ such that 
V? p'jU differs from some positive integer by less than Lp. 

Let < < min Let gi be the nearest integer of p^n. So \p[n — gi\ < Lp 

m — 1 

- J2 9i < ipm <1. 

i=0 
m — l 

Therefore, since gi G IN"^, ^ gi = n. 

j=0 



and 



< < ^- Since |p-n - .g^l < ip, we have 



Now we construct the #-PRA-C A, which satisfies the properties expressed 



in Lemma A. 2. For every i, we make gi copies of A'^. Having read for every 
i A simulates each copy of A'^ with probability^. The construction of is 
equivalent to that used in the proof of Lemma p,.'^ Therefore A is characterized 
by doubly stochastic matrices. A recognizes L with the same interval as A' , i.e., 
(ai, 02). 

Using new notations, A simulates n automata Aq, Ai, . . . , An-i with proba- 
bilities po,Pi, ■ ■ ■ ,Pn-i, respectively. Note that Vi [pi — < ^- Let pi^^ be the 
probability that Ai accepts the word oj. 

Consider lu & L. We have popo^uj + PiPi,lj + . . . + Pn-iPn-i.uj > 02- Since 
Pi < ^r^o,'^ +Pi,u: + ■■■ +Pn-i,uj) > a2- Hence 

P0,LO +PlM + ■■ ■ +Pn-l,u > — — > — - — • 

l + ip l + e 

Consider ^ ^ i. We have poPo,c + PiPi,^ + . . . + Pn-iPn-i,^ < ai- Since 
Pi > ^(Po,^ + • • ■+Pn-i,^) < 0,1. Hence 

ain ain 

Po,^+Pi,^ + ■ ■ ■+Pn-i,i < < ■ 

1 — If I — e 

□ 

Theorem A. 3. Let A be a #-PRA-C, which recognizes a language L. There 
exists a PRA-C without end-markers, which recognizes the same language. 

Proof. Consider a #-PRA-C which recognizes a language L with interval (ai, 02). 
Using Lemma [A.2| , we choose e, < £ < f^ijrf^, and construct an automaton A' 
which recognizes L with interval (ai,a2), with the following properties. 

Having read #, A' simulates A'q, . . . , A'^_i with probabilities p'q, . . . ,p'^_i, 
respectively. A'q, ... , A'j^_i are automata without end-markers. accepts uj with 
probability p'^^^. IftueL, p'^^^ +p[^^ + ... +p'^_i^^ > fff . Otherwise, if w ^ L, 

P(),uj +-Pl,uJ + ■ • • + Pm-1,LU < 1^7- 

That also implies that for every n = km, k G IN^, we are able to construct 
a #-PRA-C A which recognizes L with interval (oi, 02), such that 



a) if w G L, po,uj +Pi,uj + ■ • .+Pn-i.u, > 

b) if W ^ L, po,uj +P1.UJ + ... +Pn-l,u> < 



ain 



A simulates Aq, . . . , Let us consider the system F„ = (Aq, . . . , An-i). 

Let 5 = i(ai -t- 02). Since e < ff^, > 5 and < (5. As in the proof 



of Theorem 2.6, we define that the system accepts a word, if more than nS 
automata in the system accept the word. 

Let us take 770, such that < 770 < jf^ — S < 5 — j^. 

Tl-l 

Consider uj & L. We have that ^ pi.^j > fj^ > nS. As a result of reading w, 
/xj!^ automata in the system accept the word, and the rest reject it. The system 



Ji-1 



has accepted the word, li ^ > 5. Since < 770 < y+J ^ < « Pi,'-^ ~ 
have 

^--E?'- <^"^ (18) 



P <) :2L > ^ J. > P . 

n 



If we look on ^ as a random variable X, E{X) = ^ Pi.'^ ^"^^ variance 



n-l 

= ;i3- X Pi,^{^ —Pi,u)i therefore Chebyshev's inequality yields the foUow- 

■i=0 

ing: 



p. 



n n 



1 I 1 1 



i=0 



That is equivalent to P 



if ~ n X Pi,!' 



< ??ol > 1 



account (18), 



P J ^liL > <5 k > 1 _ 



1 



So, taking into 



(19) 



On the other hand, consider ^ ^ L. So ^ pi^^ < < nS. Again, since 



i=0 



n-l 



1=0 



p}l^>5\ <p. 



f ^ n-l 

n n ^-^ 



Pi,i 



> 



Vo 



< 



AnrjQ 



2 • 



(20) 



The constant rjo does not depend on n and n may be chosen sufficiently large. 
Therefore, by (Eoh and (|20|), the system F„ recognizes L with bounded error, if 



n > 



Following a way identical to that used in the proof of Theorem 2.6 



it is 

possible to construct a single PRA-C without end-markers, which simulates the 
system F„ and therefore recognizes the language L. □ 



